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Abstract 

We review our models of quantum associative memories that represent the “quantization” of fully 
coupled neural networks like the Hopfield model. The idea is to replace the classical irreversible 
attractor dynamics driven by an Ising model with pattern-dependent weights by the reversible 
rotation of an input quantum state onto an output quantum state consisting of a linear superpo¬ 
sition with probability amplitudes peaked on the stored pattern closest to the input in Hamming 
distance, resulting in a high probability of measuring a memory pattern very similar to the input. 
The unitary operator implementing this transformation can be formulated as a sequence of one- 
qubit and two-qubit elementary quantum gates and is thus the exponential of an ordered quantum 
Ising model with sequential operations and with pattern-dependent interactions, exactly as in the 
classical case. Probabilistic quantum memories, that make use of postselection of the measurement 
result of control qubits, overcome the famed linear storage limitation of their classical counterparts 
because they permit to completely eliminate crosstalk and spurious memories. The number of 
control qubits plays the role of an inverse fictitious temperature, the accuracy of pattern retrieval 
can be tuned by lowering the fictitious temperature under a critical value for quantum content 
association while the complexity of the retrieval algorithm remains polynomial for any number 
of patterns polynomial in the number of qubits. These models solve thus the capacity shortage 
problem of classical associative memories, providing a polynomial improvement in capacity. The 
price to pay is the probabilistic nature of information retrieval. 
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I. INTRODUCTION 


There is a growing consensus that the fundamental mechanism of human intelligence is 
simply pattern recognition, the retrieval of information based on content association, albeit 
repeated in ever increasing hierarchical structures [1] . Correspondingly, pattern recognition 
in machine intelligence [2] has made enormous progress in the last decade or so and such 
systems are now to be found in applications ranging from medical diagnosis to facial and 
voice recognition in security and digital personal assistants, the latest addition to the the 
family being self-driving cars. On the other side, the last two decades have seen the birth 
of, and an explosion of research in a new information-theoretic field: quantum information 
theory and quantum computation [1] . This chapter deals with quantum pattern recognition, 
with particular emphasis on models that are both accessible to detailed analytical treatment 
and efficiently implementable within the framework of the quantum circuit model. 

Pattern recognizers, which go also under the name of associative memories (or more pre¬ 
cisely autoassociative memories), are fundamentally different than von Neumann or Turing 
machines [5], which have grown into the ubiquitous computers that permeate our infor¬ 
mation society. Computation is not sequential but, rather, based on collective phenomena 
due to interactions among a large number of, typically redundant, elementary components. 
Information is not address-oriented, i.e. stored in look-up tables (random access memories, 
RAMs) but, rather, distributed in often very complex ways over the connections and inter¬ 
actions parameters. In traditional computers information is identihed by a label and stored 
in a database indexed by these labels. Retrieval requires the exact knowledge of the relevant 
label, without which information is simply not accessible. This is definitely not how our own 
brain works. When trying to recognize a person from a blurred photo it is totally useless 
to know that it is the 16878th person you met in your life. Rather, the recognition process 
is based on our strong power of association with stored memories that resemble the given 
picture. Association is what we use every time we solve a crossword puzzle and is distinctive 
of the human brain. 

The best known examples of pattern recognizers are neural networks |5] and hidden 
Markov models [6] , the Hopfield model [7] (and its generalization to a bidirectional associa¬ 
tive memory [8]) being the paradigm, since it can be studied analytically in detail by the 
techniques of statistical mechanics The great advantage of these architectures is that 
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they eliminate the extreme rigidity of RAM memories, which require a precise knowledge 
of the memory address and, thus, do not permit the retrieval of incomplete or corrupted 
inputs. In associative memories, on the contrary, recall of information is possible also on 
the basis of partial knowledge of its content, without knowing a precise storage location, 
which typically does not even exist. This is why they are also called “content-addressable 
memories”. 

Unfortunately, classical associative memories suffer from a severe capacity shortage. 
When storing multiple patterns, these interfere with each other, a phenomenon that goes 
under the name of crosstalk. Above a critical number of patterns, crosstalk becomes so 
strong that a phase transition to a completely disordered spin glass phase jlD] takes place. 
In this phase there is no relation whatsoever between the information encoded in the mem¬ 
ory and the original patterns. For the Hopheld model, the critical threshold on the number 
p of patterns that can be stored in a network of n binary neurons is Pmax — 0.138 n |5] . 
While various possible improvements can be envisaged, the maximum number of patterns 
remains linear in the number of neurons, Pmax = 0{n). 

The power of quantum computation |1] is mostly associated with the speed-up in com¬ 
puting time it can provide with respect to its classical counterpart, the paramount examples 
being Shor’s factoring algorithm m and Grover’s database search algorithm [12]. The effi¬ 
ciency advantage over classical computation is due essentially to the quantum superposition 
principle and entanglement, which allow for massively parallel information processing. 

The bulk of the research effort in quantum computation has focused on the “quantization” 
of the classical sequential computer architecture, which has led to the quantum circuit model 
[1], in which information processing is realized by the sequential application of a universal 
set of elementary one- and two-qubit gates to typically highly entangled quantum states of 
many qubits. The computation is said to be efficient if the desired unitary evolution of the 
quantum state can be realized by the application of a polynomial number (in terms of the 
number of involved qubits) of these elementary quantum gates. 

However, the question immediately arises if quantum mechanics can be applied success¬ 
fully also to the collective information processing paradigm typical of machine intelligence 
algorithms and, specihcally, if there are advantages in doing so. While this research has 
trailed the development of the quantum circuit model, it is presently experiencing a flurry 
of increased interest, so much so that last year NASA and Google have teamed up to found 
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the Quantum Artificial Intelligence Laboratory, entirely dedicated to develop and advance 
machine intelligence quantum algorithms. 

While speed has been the main focus of quantum computation, it can be shown that 
quantum mechanics also offers a way out from the impossibility of reconciling the associa¬ 
tion power of content-addressable memories with the requirement of large storage capacity. 
Indeed, one of us pointed out already in 2001 [T31 - IT5] that storage capacity of associative 
memories can also be greatly enhanced by the quantum superposition principle. The key 
idea is to exploit the fundamental probabilistic nature of quantum mechanics. If one is 
willing to abandon the classical paradigm of one-off retrieval and sacrihce some speed by 
repeating the information retrieval step several times, then it is possible to store any desired 
polynomial number (in terms of the number of qubits) of patterns in a quantum associative 
memory and still tune the associative retrieval to a prescribed accuracy, a large advan¬ 
tage with respect to the classical linear limitation described above. Quantum entanglement 
permits to completely eliminate crosstalk and spurious memories in a tuneable probabilis¬ 
tic content association procedure with polynomial complexity for a polynomial number of 
stored patterns. Such probabilistic quantum associative memories can thus be implemented 
efficiently. Similar ideas in this direction were developed simultaneously in HU. 

In this chapter we will review our own work on fundamental aspects of quantum as¬ 
sociative memories and quantum pattern recognition. We will begin by a short survey of 
the main features of classical fully coupled neural networks like the Hopheld model and its 
generalizations, with a special emphasis on the capacity limitation and its origin. We will 
then describe the quantization of the Hopheld model ng: the idea is to replace the clas¬ 
sical irreversible dynamics that attracts input patterns to the closest minima of an energy 
function, representing the encoded memories, with a reversible unitary quantum evolution 
that amplihes an input quantum state to an output quantum state representing one of the 
stored memories at a given computational time t. In the classical model there is a complex 
phase diagram in terms of the two noise parameters, the temperature T and the disorder 
p/n with n the number of bits and p the number of stored patterns. It is, specihcally the 
disorder due to an excessive loading factor p/n that prevents the storage of more than a 
critical number of patterns by causing the transition to a spin glass phase [10], even at zero 
temperature. Correspondingly, in the quantum version there are quantum phase transitions 
due to both disorder and quantum fluctuations, the latter being encoded in the effective 
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coupling Jt, with J being the energy parameter of the model and t being the computa¬ 
tional time (throughout the review we will use units in which c = 1 and h = 1). These are 
hrst examples of quantum collective phenomena typical of quantum machine intelligence. 
It turns out that, barring periodicity effects due to the unitary time evolution, the phase 
diagram for the quantum Hopheld model is not so different from its classical counterpart. 
Specihcally, for small loading factors the quantum network has indeed associative power, a 
very interesting feature by itself, but the maximum loading factor is still limited to p/n < 1, 
above which there is a totally disordered spin glass phase, with no association power for any 
computational time. The transition to this quantum spin glass phase takes place when one 
tries to store a number of memories that is not anymore linearly independent. 

We then turn our attention to probabilistic quantum associative memories [IMS]. The 
basic idea underlying their architecture is essentially the same as above, with one crucial 
difference: they exploit, besides a unitary evolution, a second crucial aspect of quantum 
mechanics, namely wave function collapse upon measurement |1|. A generic (pure) quantum 
state is a superposition of basis states with complex coefficients. A measurement projects 
(collapses) the state probabilistically onto one of the basis states, the probability distribution 
being governed by the squared absolute values of the superposition coefficients. Probabilistic 
quantum associative memories involve, besides the memory register itself a certain number 
b of control qubits. The unitary evolution of the input state is again determined by a 
Hamiltonian that depends only on the stored patterns. Contrary to quantized Hopheld 
memories, however, this unitary evolution mixes the memory register and the control qubits. 
After having applied the unitary evolution to the initial input state , the control qubits are 
measured. Only if one obtains a certain specihc result, one proceeds to measure the memory 
register. This procedure is called probabilistic postselection of the measurement result and 
guarantees that the memory register is in a superposition of the stored patterns such that 
the measurement probabilities are peaked on those patterns that minimize the Hamming 
distance to the input. A measurement of the memory register will thus associate input and 
stored patterns according to this probability distribution. 

Of course, if we limit ourselves to a maximum number T of repetitions, there is a non¬ 
vanishing probability that the memory retrieval will fail entirely, since the correct control 
qubit state will never be measured. One can say that information retrieval in these quantum 
memories consists of two steps: recognition (the correct state of the control qubits has been 
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obtained) and identification (the memory register is measnred to give an ontpnt). Both steps 
are probabilistic and both the recognition efficiency and the identihcation accuracy depend 
on the distribution of the stored patterns: recognition efficiency is best when the number 
of stored patterns is large and the input is similar to a substantial cluster of them, while 
identihcation accuracy is best for isolated patterns which are very different from all other 
ones, both very intuitive features. Both recognition efficiency and identihcation accuracy 
can be tuned to prescribed levels by varying the repetition threshold T and the number b of 
control qubits. 

The accuracy of the input-output association depends only on the choice of the number b 
of control qubits. Indeed, we will show that t = 1/b plays the role of an ehective temperature 
|15j . The lower t, the sharper is the corresponding ehective Boltzmann distribution on the 
states closest in Hamming distance to the input and the better becomes the identihcation. 
By averaging over the distribution of stored patterns with Hamming distance to the input 
above a threshold d one can eliminate the dependence on the stored pattern distribution and 
derive the ehective statistical mechanics of quantum associative memories by introducing 
the usual thermodynamic potentials as a function of d and the ehective temperature t = 1/b. 
In particular, the free energy F{t) describes the average behaviour of the recall mechanism 
and provides concrete criteria to tune the accuracy of the quantum associative memory. 
By increasing b (lowering t), the associative memory undergoes a phase transition from a 
disordered phase with no correlation between input and output to an ordered phase with 
perfect input-output association encoded in the minimal Hamming distance d. This extends 
to quantum information theory the relation with Ising spin systems known in error-correcting 
codes [18] and in public key cryptography [T9] . 

The recognition efficiency can be tuned mainly by varying the repetition threshold T: 
the higher T, the larger the number of input qubits that can be corrupted without affecting 
recognition. The crucial point is that the recognition probability is bounded from below by 
(p— l)(7r/2)^^/For any number of patterns, thus, a repetition threshold T polynomial 
in n guarantees recognition with probability 0(1). Due to the factor (p—1) in the numerator, 
whose origin is exclusively quantum mechanical, the number of repetitions required for 
efficient recognition would actually be polynomial even for a number of patterns exponential 
in n. The overall complexity of probabilistic associative quantum memories is thus bounded 
by the complexity 0(p(2n -|- 3)) of the unitary evolution operator. Any polynomial number 
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of patterns p = 0{n^) can be encoded and retrieved efficiently in polynomial compnting 
time. The absence of spnrions memories leads to a snbstantial storage gain with respect to 
classical associative memories, the price to pay being the probabilistic natnre of information 
recall. 

II. THE CLASSICAL HOPFIELD MODEL 

Historically, the interest in nenral networks [5] has been driven by the desire to bnild 
machines capable of performing tasks for which the traditional sequential computer archi¬ 
tecture is not well suited, like pattern recognition, categorization and generalization. Since 
these higher cognitive tasks are typical of biological intelligences, the design of these parallel 
distributed processing systems has been largely inspired by the physiology of the human 


brain. 


The Hopfield model is one of the best studied and most successful neural networks. It 


was designed to model one particular higher cognitive function of the human brain, that of 


associative pattern retrieval or associative memory. 

The Hopheld model consists of an assembly of n binary neurons Si, i = 1.. .n [ 20 ], which 
can take the values ±1 representing their firing (-1-1) and resting (-1) states. The neurons 
are fully connected by symmetric synapses with coupling strengths Wij = Wji {wu = 0). 
Depending on the signs of these synaptic strengths, the couplings will be excitatory (> 0) 
or inhibitory (< 0). The model is characterised by an energy function 



and its dynamical evolution is defined by the random sequential updating (in time t) of the 
neurons according to the rule 


Si{t + 1) = sign (hi(t)) , 

hi{t) 

where hi is called the local magnetization. 

The synaptic coupling strengths are chosen according to the Hebb rule 



( 2 ) 

(3) 



( 4 ) 
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where /r = l...p are p binary patterns to be memorized. An associative memory is 
defined as a dynamical mechanism that, upon preparing the network in an initial state 
retrieves the stored pattern that most closely resembles the presented pattern where 
resemblance is determined by minimizing the Hamming distance, i.e. the total number of 
different bits in the two patterns. As emerges clearly from this definition, all the memory 
information in a Hopfield neural network is encoded in the synaptic strengths. 

It can be easily shown that the dynamical evolution ([^ of the Hopfield model satisfies 
exactly the requirement for an associative memory. This is because: 

• The dynamical evolution Q minimizes the energy functional ([^, i.e. this energy 
functional never increases when the network state is updated according to the evolution 
rule ([^. Since the energy functional is bounded by below, this implies that the network 
dynamics must eventually reach a stationary point corresponding to a, possibly local, 
minimum of the energy functional. 

• The stored patterns correspond to, possibly local, minima of the energy functional. 
This implies that the stored patterns are attractors for the network dynamics (|^. An 
initial pattern will evolve till it overlaps with the closest (in Hamming distance) stored 
pattern, after which it will not change anymore. 

Actually, the second of these statements must be qualified. Indeed, the detailed behavior 
of the Hopfield model depends crucially upon the loading factor a = p/n, the ratio between 
the number of stored memories and the number of available bits. This is best analyzed in 
the thermodynamic limit p —)■ cxd, n —)■ oo, in which the different regimes can be studied 
by statistical mechanics techniques nu and characterized formally by the values of critical 
parameters. 

For a < alcrit — 0.051, the system is in a ferromagnetic {F) phase in which there 
are global energy minima corresponding to all stored memories. The former differ from 
the original input memories only in a few percent of the total number of bits. Mixing 
between patterns leads to spurious local energy minima. These, however are destabilized at 
sufficiently high temperatures. 

For alcrit — 0.051 < a < a2crit — 0.138 the system is in a mixed spin glass (SG) [TU] and 
ferromagnetic phase. There are still minima of sizable overlap with the original memories but 
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they are now only metastable states. The true ground state is the spin glass, characterized 
by an exponentially increasing number of minima due to the mixing of original memories 
(crosstalk). The spin glass phase is orthogonal to all stored memories. If an input pattern is 
sufficiently near (in Hamming distance) to one of the original memories it will be trapped by 
the corresponding metastable state and the retrieval procedure is successful. On the other 
hand, if the input pattern is not sufficiently close to one of the stored memories, the network 
is confused and it will end up in a state very far from all original memories. 

For a > a2crit — 0.138, the system is in a pure spin glass {SG) phase (TU] in which all 
retrieval capabilities are lost due to an uncontrolled proliferation of spurious memories. It is 
this phase transition to a spin glass that limits the storage capacity of the Hopheld model to 
a = p/n < 0.138. While various improvements are possible, the storage capacity of classical 
associative memories remains linearly bounded by the number n of classical bits [5]. 

III. QUANTUM NEURAL NETWORKS AND THE QUANTIZATION OF THE 
HOPFIELD MODEL 

In this section we introduce a quantum information processing paradigm that is different 
from the standard quantum circuit model [16]. Instead of one- and two-qubit gates that 
are switched on and off sequentially, we will consider long-range interactions that dehne a 
fully-connected quantum neural network of qubits. This is encoded in a Hamiltonian that 
generates a unitary evolution in which the operator acting on one qubit depends on the 
collective quantum state of all the other qubits. Note that some of the most promising 
technologies for the implementation of quantum information processing, like optical lattices 
[2T] and arrays of quantum dots [22| rely exactly on similar collective phenomena. 

In mathematical terms, the simplest classical neural network model is a graph with the 
following properties: 

• A state variable Si is associated with each node (neuron) i. 

• A real-valued weight Wij is associated with each link (synapse) {ij) between two nodes 
i and j. 

• A state-space-valued transfer function f{hi) of the synaptic potential hi = Yhj 
determines the dynamics of the network. 
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Directed graphs correspond to feed-forward neural networks [5] while undirected graphs with 
symmetric weights contain feed-back loops. If the graph is complete one has fully-connected 
neural networks like the Hopheld model. Two types of dynamical evolution have been 
considered: sequential or parallel synchronous. In the hrst case the neurons are updated 
one at a time according to 

-h 1) = / , (5) 

while in the second case all neurons are updated at the same time. The simplest model is 
obtained when neurons become binary variables taking only the values Si = ±1 for all i and 
the transfer function becomes the sign function. This is the original McCullogh-Pitts [20] 
neural network model, in which the two states represent quiescent and bring neurons. 

As we have seen in the previous section, the Hopheld model [7| is a fully-connected 
McCullogh-Pitts network in which the synaptic weights are symmetric quantities chosen 
according to the Hebb rule |5| 

1 ^ 

Wij = Wji = - , Wii = 0 . ( 6 ) 

^ /.=! 

and in which the the dynamics-debning function / is the sign function, / = sign. This 
dynamics minimises the energy function 


E 





SiSj 


Si = ±1 , j = 1... n , 


(7) 


where n is the total number of neurons and are the p binary patterns to be memorized 

(C" = ±1) 

A quantum McCullogh-Pitts network can correspondingly be debned as a graph that 
satisbes: 


• A two-dimensional Hilbert space Hi is associated with each node (neuron) i, i.e. each 
neuron becomes a qubit whose basis states can be labeled as |0 > and |1 >. 

• A vector-valued weight Wij is associated with each link (synapse) {ij) between two 
nodes i and j. 

• The synaptic potential becomes an operator hi = '^jWijaj, where a* = {af,a^,ai) is 
the vector of Pauli matrices acting on the Hilbert space Hi. A unitary operator U{hi) 
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determines the dynamics of the network starting from an initial input quantum state 
on the product Hilbert space of all qubits. 

In case of feed-forward quantum networks on directed graphs only a subset of qubits is 
measured after the unitary evolution, in case of fully connected quantum networks with 
symmetric weights the state of the whole network is relevant. 

The crucial difference with respect to classical neural networks concerns the interactions 
between qubits. In the classical model, the dynamics (|^ induced by the transfer function 
is fully deterministic and irreversible, which is not compatible with quantum mechanics. 
A hrst generalization that has been considered is that of stochastic neurons, in which the 
transfer function determines only the probabilities that the classical state variables will take 
one of the two values: ni{t -|- 1) = ±1 with probabilities /(±/ij(t)), where / must satisfy 
f{h —)■ —oo) = 0, f{h —)■ -|-cx)) = 1 and f{h) + f{—h) = 1. While this modihcation makes 
the dynamics probabilistic by introducing thermal noise, the evolution of the network is still 
irreversible since the actual values of the neurons are prescribed after an update step. In 
quantum mechanics the evolution must be reversible and only the magnitudes of the changes 
in the neuron variables can be postulated. Actually, the dynamics must generate a unitary 
evolution of the network. 

It is known that two-level unitary gates are universal, i.e. every unitary matrix on an 
n-dimensional Hilbert space may be written as a product of two-level unitary matrices. 
However, an arbitrary unitary evolution cannot be implemented as a sequential succession 
of a discrete set of elementary gates, nor can it be approximated efficiently with a polynomial 
number of such gates |1]. In general, quantum neural networks as dehned above, have to 
be thought of as dehned by Hamiltonians H that code hard-wired qubit interactions and 
generate a unitary evolution U = exp(2i7t). This corresponds to the parallel synchronous 
dynamics of classical neural networks. Only in particular cases, one of which will be the 
subject of the next section, does this unitary evolution admit a representation as a sequential 
succession of a discrete set of elementary one- and two-bit gates. In this cases the network 
admits a sequential dynamics as its classical counterpart. 

We now describe a direct “quantization” of the Hopheld model in this spirit, i.e. by 
dehning a quantum Hamiltonian that generalizes Q. At hrst sight one would be tempted 
to simply replace the classical spins s* of Q with the third Pauli matrix erf acting on the 
Hilbert space Hi. This however would accomplish nothing, the model would still be identical 


12 


to the original classical model, since all terms in the Hamiltonian would commute between 
themselves. A truly quantum model must involve at least two of the three Pauli matrices. 
In [in] we have proposed the following “transverse” Hamiltonian: 

'^ = JYI ’ (s) 

ij 

where k = x,y,z denote the Pauli matrices and J is a coupling constant with the 
dimensions of mass (we remind the reader that we use units in which c = l,h = 1). This 
generates a unitary evolution of the network: 


|'0(f) >= exp{im) 1-00 > , 


(9) 


where |'0o >= |V’(^ = 0) >• Specihcally, we will choose as initial conhguration of the network 
the uniform superposition of all computational basis states [Ij 

^ 2"-l 

1^0 >=^ ■ ( 10 ) 
'' x=0 

This corresponds to a ’’blank memory” in the sense that all possible states have the same 
probability of being recovered upon measurement. In the language of spin systems this is a 
state in which all spins are aligned in the x direction. 

Inputs can be accomodated by adding an external transverse magnetic held along 
the y axis, i.e. modifying the Hamiltonian to 


n = +9YI ’ 


( 11 ) 




where = Ylj This external magnetic held can be thought of as arising from the 

interaction of the network with an additional “sensory” qubit register prepared in the state 
the synaptic weights between the two layers being identical to those of the network 
self-couplings. 

Let us now specialize to the simplest case of one assigned memory ^ in which Wij = / n. 
In the classical Hopheld model there are two nominal stable states that represent attractors 
for the dynamics, the pattern ^ itself and its negative —Correspondingly, the quantum 
dynamics dehned by the Hamiltonian and the initial state (10) have a Z 2 symmetry 


generated by corresponding to the inversion |0 ><H- |1 > of all qubits. 

As in the classical case we shall analyze the model in the mean held approximation. 
In this case, the mean held represents the average over quantum huctuations rather than 
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thermal ones but the principle remains the same. The mean held model becomes exactly 
solvable and allows to derive self-consistency conditions on the average overlaps with the 
stored patterns. In the classical case, the mean held approximation is known to become 
exact for long-range interactions [23] . 

In the quantum mean-held approximation operators are decomposed in a sum of 
their mean values in a given quantum state and huctuations around it, af =< erf > 
-1- (erf — < erf >), and quadratic terms in the huctuations are neglected in the Hamiltonian. 
Apart from an irrelevant constant, this gives 


H„, = (< ht > +^hT‘) + < ft? > , 


<K> = 


j 


Wij < >= 


( 12 ) 


where = {1/n) Yli < '^f > is the average overlap of the state of the network with 
the stored pattern. This means that each qubit i interacts with the average magnetic held 
(synaptic potential) < hf > due to all other qubits: naturally, the correct values of these 
mean magnetic helds < hf > have to be determined self-consistently. 

To this end we compute the average pattern overlaps using the mean held Hamiltonian 


(12) to generate the time evolution of the quantum state. This reduces to a sequence of 
factorized rotations in the Hilbert spaces of each qubit, giving 

iV 

sin 2Jt\m\ , 

m~ = -^-sin 2Jt\m\ , (13) 


= 




|m| 

+ {g/ J)M^ 


m 


where \m\ = y {my)‘^ -f (m^ -|- {g/J)M^Y and = {1/n) average overlap 

of the external stimulus with the stored memory. 

Before we present the detailed solution of these equations, let us illustrate the mechanism 
underlying the quantum associative memory. To this end we note that, for g = 0, the pattern 
overlaps and in the two directions cannot be simultaneously diherent from zero. As 
we show below, only ^ 0 for J > 0 (for J < 0 the roles of and are interchanged). 
In this case the evolution of the network becomes a sequence of n rotations 


( cos{Jt < hf >) sin(Jf < hf >) 
I —sin(Jf < hf >) cos(Jf < hf >) 


(14) 
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in the two-dimensional Hilbert spaces of each qubit i. The rotation parameter is exactly 
the same synaptic potential hi which governs the classical dynamics of the Hopheld model. 


When these rotations are applied on the initial state (10) they amount to a single update 
step transforming the qubit spinors into 


1 / cos( < hf >) + sin( < hf >) 

y cos( Jt < hi >) — sin( Jt < /if >) 

This is the generalization to quantum probability amplitudes of the probabilistic formu¬ 
lation of classical stochastic neurons. Indeed, the probabilities for the qubit to be in its 
eigenstates ±1 after a time /, obtained by squaring the probability amplitudes, are given 
by /(± < h^ >), where /(< h^ >) = (1 -|- sin(2J/ < h^ >))/2 has exactly the prop¬ 
erties of an activation function (alternative to the Fermi function), at least in the region 
Jt < 7r/4. In this correspondence, the effective coupling constant Jt plays the role of the 
inverse temperature, as usual in quantum mechanics. 

We shall now focus on a network without external inputs. In this case the equation for 
the average pattern overlaps has only the solution \m\ = 0 for 0 < Jt < 1/2. For such small 
effective couplings (high effective temperatures), corresponding to weak synaptic connections 
or to short evolution times, the network is unable to remember the stored pattern. For 
1/2 < Jt, however, the solution \m\ = 0 becomes unstable, and two new stable solutions 
= ±mo appear. This means that the reaction of the mean orientation of the qubit 
spinors against a small deviation 5m^ from the |m| = 0 solution is larger than the deviation 
itself. Indeed, any so small external perturbation {g/J)M^ present at the bifurcation time 
t = 1/2 J is sufficient for the network evolution to choose one of the two stable solutions, 
according to the sign of the external perturbation. The point Jt = 1/2 represents a quantum 
phase transition [2l] from an amnesia (paramagnetic) phase to an ordered (ferromagnetic) 
phase in which the network has recall capabilities: the average pattern overlap is the 
corresponding order parameter. In the ferromagnetic phase the original Z 2 symmetry of the 
model is spontaneously broken. 

For Jt = 7r/4, the solution becomes |mo| = 1, which means that the network is capable 
of perfect recall of the stored memory. For Jt > ti/A the solution mo decreases slowly to 0 
again. Due to the periodicity of the time evolution, however, new stable solutions mg = ±1 
appear at Jt = {1 + 4n)7r/4 for every integer n. Also, for Jt > 37r/4, new solutions with 
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7 ^ 0 and = 0 appear. These, however, correspond all to metastable states. Thns, 
t = tt/AJ is the ideal compntation time for the network. 

The following pictnre of qnantnm associative memories emerges from the above constrnc- 
tion. States of the network are generic linear snperpositions of compntational basis states. 
The network is prepared in the state |'0o > and is then let to nnitarily evolve for a time t. 
After this time the state of the network is measnred, giving the resnlt of the compntation. 
Dnring the evolntion each qnbit npdates its qnantnm state by a rotation that depends on the 
aggregated synaptic potential determined by the state of all other qnbits. These synaptic 
potentials are snbject to large qnantnm flnctntations which are symmetric aronnd the mean 
valne < >= 0. If the interaction is strong enongh, any external distnrbance will canse 

the flnctnations to collapse onto a collective rotation of all the network’s qnbits towards the 
nearest memory. 

We will now tnrn to the more interesting case of a hnite density a = p/n of stored 
memories in the limit n —)■ cx). In this case the state of the network can have a hnite overlap 
with several stored memories simnltaneonsly. As in the classical case we shall focus on the 
most interesting case of a single ” condensed pattern”, in which the network uniquely recalls 
one memory without admixtures. Without loss of generality we will chose this memory to 
be the hrst, p = 1, omitting then the memory superscript on the corresponding overlap 
m. Correspondingly we will consider external inputs so that only = M ^ 0. For 

simplicity of presentation, we will focus directly on solutions with a non-vanishing pattern 
overlap along the z-axis, omitting also the direction superscript 2 ;. 

In case of a hnite density of stored patterns, one cannot neglect the noise ehect due to 


the inhnite number of memories. This changes (13) to 

1 


m = — 
n 


sin 2Jt (m + + A 




( 16 ) 


A. 

As in the classical case we will assume that and {m^, p, ^ 1} are all independent random 
variables with mean zero and we will denote by square brackets the conhgurational average 
over the distributions of these random variables. As a consequence of this assumption, the 
mean and variance of the noise term are given by [A*] = 0 and [A^] = ar, where 

1 


r = — 
a 


[(“"t] 


(17) 
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is the spin-glass order parameter [TO]. According to the central limit theorem one can now 
replace n~^ Yhi (16) by an average over a Gaussian noise, 

f dz 


m = I , _ e 2 sin 2Jt (m + + Jarz 

J \ J ^ 


(18) 


The second order parameter r has to be evaluated self-consistently by a similar procedure 


starting from the equation analogous to eq. (16) for /i 7 ^ 1. In this case one can use <C 1 
for /i 7 ^ 1 to expand the transcendental function on the right-hand side in powers of this 
small parameter, which gives 


dz 


V = 


X = 


TT 


V2 

dz 
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:= e 2 sin 2Jt m + —M + y arz 


J 


TT 


9 


= e 2 cos 2Jt m + —M + Jarz 


J 


■' 


(19) 


where n = (1 — 2JtxYr. Solving the integrals gives dually the following coupled equations 
for the two order parameters m and r: 


m = sin 2Jt ( m -|- —M 


2( Ji)^Qr 


1 

r = - 


1 — cos AJt {m + jM) e 


( 20 ) 


2 (1 — 2 Jtcos 2Jt (m -|- jM) e 2 (J 02 arj 

In terms of these order parameters one can distinguish three phases of the network. First 
of all the value of m determines the presence (m > 0 ) or absence (m = 0 ) of ferromagnetic 
order (F). If m = 0 the network can be in a paramagnetic phase (P) if also r = 0 or a 
quantum spin glass phase (SG) if r > 0. The phase structure resulting from a numerical 


solution of the coupled equations (20) for = 0 is shown in Fig. 1. 

For a < 0.025 the picture is not very different from the single memory case. For large 
enough computation times there exists a ferromagnetic phase in which the m = 0 solution is 
unstable and the network has recall capabilities. The only difference is that the maximum 
value of the order parameter m is smaller than 1 (recall is not perfect due to noise) and the 
ideal computation time t at which the maximum is reached depends on a. For 0.025 < a < 
1.000 instead, ferromagnetic order coexists as a metastable state with a quantum spin glass 
state. This means that ending up in the memory retrieval solution depends not only on 
the presence of an external stimulus but also on its magnitude; in other words, the external 
pattern has to be close enough to the stored memory in order to be retrieved. For 1 < a all 
retrieval capabilities are lost and the network will be in a quantum spin glass state for all 
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FIG. 1; The phase structure of quantum associative memories with finite density of stored 
patterns. P, F and SG denote (quantum) paramagnetic, ferromagnetic and spin-glass phases, 
respectively. F -|- SG denotes a mixed phase in which the memory retrieval solution is only locally 
stable. 

computation times (after the transition from the quantum paramagnet). a = 1 is thus the 
maximum memory capacity of this quantum network. Note that a = 1 corresponds to the 
maximum possible number of linearly independent memories. For memory densities smaller 
but close to this maximum value, however, the ferromagnetic solution exists only for a small 
range of effective couplings centered around Jt ~ 9: for these high values of Jt the quality 
of pattern retrieval is poor, the value of the order parameter m being of the order 0.15-0.2. 
Much better retrieval qualities are obtained for smaller effective couplings: e.g. for Jt = 1 
the order parameter is larger than 0.9 (corresponding to an error rate smaller than 5%) for 
memory densities up to 0.1. In this case, however the maximum memory density is 0.175, 
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comparable with the classical result of the Hopheld model. Quantum mechanics, here, does 
not carry any advantage. 

IV. PROBABILISTIC QUANTUM MEMORIES 

We have seen in the last section that crosstalk prevents the amplihcation of patterns stored 
in the weights of a simple quantum Hamiltonian like ([^ when the loading factor exceeds a 
linear bound comparable with the classical one. In this section we show that this limit can be 
overcome by probabilistic quantum memories, which use postselection of the measurement 
results of certain control qubits [IMS]. The price to pay is that such probabilistic memories 
require repetitions of the retrieval process and that there is non-vanishing probability that 
this fails entirely. When it is successful, however, it allows retrieval of the most appropriate 
pattern among a polynomial pool instead of a linear one. 


A. Storing patterns 


Let us start by describing the elementary quantum gates |1| that we will use in the rest 
of the paper. First of all there are the single-qbit gates represented by the Pauli matrices 
cr*, i = x,y,z. The hrst Pauli matrix a*, in particular, implements the NOT gate. Another 
single-qbit gate is the Hadamard gate H, with the matrix representation 


H 


1 

71 



( 21 ) 


Then, we will use extensively the two-qbit XOR (exclusive OR) gate, which performs a 
NOT on the second qbit if and only if the hrst one is in state |1). In matrix notation 
this gate is represented as XOR = diag(l,cr*), where 1 denotes a two-dimensional identity 
matrix and acts on the components |01) and |11) of the Hilbert space. The 2XOR, or 
Toffoli gate is the three qbit generalization of the XOR gate: it performs a NOT on the 
third qbit if and only if the hrst two are both in state |1). In matrix notation it is given 
by 2XOR = diag (1,1, In the storage algorithm we shall make use also of the nXOR 
generalization of these gates, in which there are n control qbits. This gate is also used in the 
subroutines implementing the oracles underlying Grover’s algorithm |1| and can be realized 
using unitary maps ahecting only few qbits at a time [25|, which makes it efficient. All these 
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are standard gates. In addition to them we introduce the two-qbit controlled gates 


CS^ = | 0 )( 0 | 0 1 +| 1 )( 1 | 0 5 ', 



( 22 ) 


ioT i = 1,... ,p. These have the matrix notation CS^ = diag (1, 5*). For all these gates we 
shall indicate by subscripts the qbits on which they are applied, the control qbits coming 
always hrst. 

The construction of quantum memories relies, of course, on the fundamental fact that 
one can use entanglement to ’’store” an arbitrary number p of binary patterns p* of length 
n in a quantum superposition of just n qubits. 


\m) = —^ |p‘) . 


The idea of the memory architecture consists thus of two steps: 


(23) 


• Generate the state \m) by a unitary evolution M from a simple prepared state, say 

|0i,... ,0n), \m) = M|0i,... ,0n). 

• Given an input state |i) = |ii,..., i„), generate from \m) a superposition of the pattern 
states that is no more uniform but whose amplitudes dehne a probability distribution 
peaked on the pattern states with minimal Hamming distance front the input. It is 
this step that involves both a unitary evolution and a postselection of the measurement 
result. 


The quantum memory itself is the unitary operator M that codes the p patterns. It dehnes 
implicitly a Hamiltonian through the formal relation M = exp(z'H), a Hamiltonian that 
represents pattern-dependent interactions among the qubits. This is the quantum general¬ 
ization of the classical Hopheld model. In order to dispel any possible misunderstandings 
right away, we point out that this is quite different to the communication of classical infor¬ 
mation via a quantum channel, limited by the Holevo theorem [2^], as we discuss in detail 
below. 

In order to construct explicitly the quantum memory M we will start from an algorithm 
that loads sequentially the classical patterns into an auxiliary register, from which they 
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are then copied into the actual memory register. A hrst version of such an algorithm was 
introduced in [27j. The simplihed version that we present here is due to [TH] . 

We shall use three registers: a hrst register p of n qbits in which we will subsequently 
feed the patterns p* to be stored, a utility register u of two qbits prepared in state |01), and 
another register m of n qbits to hold the memory. This latter will be initially prepared in 
state I Oi,..., On). The full initial quantum state is thus 

IV'o) = • (24) 

The idea of the storage algorithm is to separate this state into two terms, one corresponding 
to the already stored patterns, and another ready to process a new pattern. These two parts 
will be distinguished by the state of the second utility qbit M 2 : |0) for the stored patterns 
and |1) for the processing term. 

For each pattern p* to be stored one has to perform the operations described below: 

n 

\i,\) = J] IV-j) . (25) 

This simply copies pattern p* into the memory register of the processing term, identihed by 

K) = |i). 

n 

m = n i^i), 

i=i 

m =nXORm,...m^uM) . ( 26 ) 

The hrst of these operations makes all qbits of the memory register |l)’s when the contents 
of the pattern and memory registers are identical, which is exactly the case only for the 
processing term. Together, these two operations change the hrst utility qbit ui of the 
processing term to a |1), leaving it unchanged for the stored patterns term. 

Hi) = 1 ^'). ( 27 ) 

This is the central operation of the storing algorithm. It separates out the new pattern to 
be stored, already with the correct normalization factor. 

1 ^*) =nXOR^,.„m , 

1 

1^*) = n XOR^^^ NOT^^ \4) . (28) 

j=n 
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These two operations are the inverse of eqs.(26) and restore the ntility qbit ui and the 
memory register m to their original valnes. After these operations on has 


= ^ 5;ip‘;00;p‘) + 

k=l 



b‘;0i;p*) 


With the last operation, 


14)=n 2X04 


VjU2mj 


W4>. 


(29) 


(30) 


j=n 


one restores the third register m of the processing term, the second term in eq.(29) above, to 
its initial valne |0i,..., 0„). At this point one can load a new pattern into register p and go 
throngh the same rontine as jnst described. At the end of the whole process, the m-register 


is exactly in state |m), eq. (23). 

Any qnantnm state can be generically obtained by a nnitary transformation of the initial 
state |0,..., 0). This is trne also for the memory state |m). In the following we will explicitly 
constrnct the nnitary memory operator M which implements the transformation \m) = 
M |0,...,0). 

To this end we introdnce hrst the single-qbit nnitary gates 


Uj = cos 1 + i sin j era , (31) 

where Ua is the second Panli matrix. These operators are snch that their prodnet over the 
n qbits generates pattern p* ont of |0,..., 0): 



= P* |0,...,0) , 


pi 

III 

(32) 


We now introdnce, in addition to the memory register proper, the same two ntility qbits as 
before, also initially in the state |0). The idea is, exactly as in the seqnential algorithm, to 
split the state into two parts, a storage term with |Ma) = |0) and a processing term with 
|Ma) = |1)- Therefore we generalize the operators P* dehned above to 

n 

cp'u ,= n • p3) 

i=i 

which loads pattern p* into the memory register only for the processing term. It is then easy 
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to check that 


|m;00) =M |0,...,0;00) , 


M = n [{CPiX' 

i=l 


X 


X NOT, 


U2 


( 34 ) 


From this construction it is easy to see that the memory operator M involves a number 
p{2n + 3) + 1 of elementary one- and two-qbit gates. It is thus efficient for any number 
p of patterns polynomial in the number n of qubits. It is interesting to note that another 
version of this operator has been recently derived in [28], with a bound of 0{pn^/6) on its 
complexity. This is also linear in p, implying again efficiency for a polynomial number of 
patterns. 

While the memory construction we have presented here mirrors its classical counterpart, 
it is important to stress one notable difference. In classical associative memories, patterns are 
stored as minima of an energy landscape or, alternatively in the parameters of a dynamical 
evolution law jSj. This is reflected verbatim in the construction of the unitary operator M 


in (34), which completely codes the patterns in a dynamical law, albeit reversible in the 
quantum case. In quantum mechanics, however, there is the possibility of shuffling some 
(but not all, as we will shortly see) information about the patterns from the unitary evolution 
law M onto a set of quantum states. 

The ideal, most compressed quantum memory would indeed be the quantum superpo¬ 


sition of patterns \m) in (23) itself. This, however is impossible. If the memory state has 
to be used for information retrieval it must be measured and this destroys all information 
about the patterns (save the one obtained in the measurement). The quantum state must 
therefore be copied prior to use and this is impossible since the linearity of quantum me¬ 
chanics forbids exact universal cloning of quantum states [29|. Universal cloning of quantum 
states is possible only in an approximate sense [30] and has two disadvantages: first of all 
the copies are imperfect, though optimal [31] and secondly, the quality of the master copy 
decreases with each additional copy made. Approximate universal cloning is thus excluded 
for the purposes of information recall since the memory would be quickly washed out. 

This leaves state-dependent cloning [32] as the only viable option. State-dependent don¬ 
ers are designed to reproduce only a finite number of states and this is definitely enough 


for our purposes. Actually the memory M in (34) is equivalent to a state-dependent doner 
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for the the state \m) in (23). In this case the information about the stored patterns is 
completely coded in the memory operator, or equivalently, the state-dependent doner. It 
is possible, however, to subdivide the pattern information among an operator and a set 
of quantum states, obviously including |m), by using a probabilistic cloning machine [33] . 
Probabilistic doners copy quantum states exactly but the copying process is not guaranteed 
to succeed and must be repeated until the measurement of an auxiliary register produces a 
given result associated with copying success. In general, any number of linearly independent 
states can be copied probabilistically. In the present case for example, it would be sufficient 
to consider any dummy state \d) different from \m) (for more than two states the condition 
would be linear independence) and to construct a probabilistic cloning machine for these 
two states. This machine would reproduce \m) with probability pm and Id) with probability 
Pd'i a flag would tell when the desired state |m) has been obtained. In order to obtain an 
exact copy of |m) one would need then 1/pm trials on average. The master copy would be 
exactly preserved. 

The cloning efficiencies of the probabilistic doner of two states are bounded as follows 


Pm + Pd < 


(35) 


1 -I- {d\m) 

This bound can be made large by choosing \d) as nearly orthogonal to |m) as possible. A 
simple way to achieve this for a large number of patterns would be, for example, to encode 
also the state 

\d) = ^ ^(-l)‘+i|pi> (36) 

i=l 

together with |m) when storing information. This can be done easily by using alternately 
the operators S'* and (S'*) ^ in the storing algorithm above. For binary patterns which are 
all different from one would then have 


|m) = 0 , 

]m) = - , 

P 


p even , 
p odd , 


(37) 


and the bound for the cloning efficiencies would be very close to its maximal value 2 in both 
cases. 

The quantum network for the probabilistic doner of two states has been developed in 
It can be constructed exclusively out of the two simple distinguishability tranfer (D) 
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and state separation (S) gates. As expected, these gates embody information abont the 
two states to be cloned. Part of the memory, therefore, still resides in the cloning network. 
The pattern-dependence of the network doner can be decreased by choosing a larger set of 
states in the pool that can be cloned, so that the doner becomes more and more generic. 
On one side this decreases also the efficiency of the doner, so that more repetitions are 
reqnired, on the other side, since the clonable pool is limited to a set of linearly independent 
states, one can never eliminate completely the pattern-dependence of the cloning operator. 
This is why the original claim of an exponential capacity increase of qnantnm associative 
memories [13], based on probabilistic cloning of the state |m), is excessive. The complexity 
of the doner, be it exact as in the memory operator M or probabilistic, remains linear in 
the nnmber of patterns and the reqnirement of efficient implementability limits thus p to 
a polynomial function of the number n of qubits., which is still a large improvement upon 
classical associative memories. 


B. Retrieving patterns 


Let us now assume we are given a binary input i that is a corrupted version of one of the 
patterns stored in the memory. The task of the retrieval algorithm is to ’’recognize” it, i.e. 
output the stored pattern that most resembles this input, where similarity is dehned (here) 
in terms of the Hamming distance, the number of different bits between the two patterns, 
although other similarity measures [? ] could also be incorporated. 

The retrieval algorithm requires also three registers. The hrst register z of n qbits contains 
the input pattern; the second register m, also of n qbits, contains the memory |m); hnally 
there is a control register c with b qbits all initialized in the state |0). The full initial quantum 
state is thus: 


iV’o) 


V n 


(38) 


where |z) = |zi,... ,Zn) denotes the input qbits, the second register, m, contains the memory 


(23) and all b control qbits are in state |0). Applying the Hadamard gate to the hrst control 
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qbit one obtains 



■,0fe) 


^ ti 

,0fe) . 

(39) 

Let us now apply to this state the following combination of quantum gates: 


n 

\i’2) = n 

i=i 

1 ^ 1 ) , 

(40) 

As a result of the above operation the memory register qbits are in state 1) if ij 

and are 

identical and 0) otherwise: 




•,0b) 


1)1'.'* .ii,... 

',0b) , 

(41) 

where = 1 if and only if ij = pj and = 0 otherwise. 




Consider now the following Hamiltonian: 




Cl 


id 


H 


E 

i=i 


CT^ + 1 


(42) 


where is the third Pauli matrix. "H measures the number of O’s in register m, with a plus 
sign if Cl is in state |0) and a minus sign if ci is in state |1). Given how we have prepared 
the state IV’ 2 ), this is nothing else than the number of qbits which are different in the input 
and memory registers i and m. This quantity is called the Hamming distance and represents 
the (squared) Euclidean distance between two binary patterns. 


Every term in the superposition (41) is an eigenstate of H with a different eigenvalue. 
Applying thus the unitary operator exp(z7r'H/2?7,) to 1-02) one obtains 


1 ^ 3 ) 

= e*2«^ 1-02) , 


(43) 

iV’s) 


..,0b) 



^ k=l 

■., Ob) , 
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where dn {i,P^) denotes the Hamming distance bewteen the inpnt i and the stored pattern 




In the hnal step we restore the memory gate to the state \m) by applying the inverse 


transformation to eq. (40) and we apply the Hadamard gate to the control qbit Ci, thereby 
obtaining 

1 


1^4) 

j=n 

not^^ 1^3) , 


(44) 

1^4) 

1 P ^ 

= — > COS — dn 

(b/) lb/;0i,. 

..,06) 



1 p ^ 

+^y]sin —d„ 
VPti 2ii 

(b/) lb/;ii,-- 

.,06). 



The idea is now to repeat the above operations sequentially for all b control qbits ci to 
Cfc. This gives 

T P b 


yP k=i 1=0 


b-l (TT 


(*,/)) X 


sm 




(45) 


where {J’'} denotes the set of all binary numbers of b bits with exactly I bits 1 and (6 — 1) 
bits 0. 

Note that one could also dispense with a register for the input but, rather, code also the 
input directly into a unitary operator. Indeed, the auxiliary quantum register for the input 


is needed only by the operator (40) leading from (39) to (41). The same result (apart from 
an irrelevant overall sign) can be obtained by applying 


I 

i=i 
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Uj = sin ( —ij ) 1 + i cos ( —ij ) a 2 , 


TT 


(46) 


directly on the memory state \m). The rest of the algorithm is the same, apart the reversing 
of the operator (40) which needs now the operator 

The end effect of the information retrieval algorithm represents thus a rotation of the 
memory quantum state in the enlarged Hilbert space obtained by adding b control qbits. 
The overall effect of this rotation is an amplitude concentration on memory states similar to 
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the input, if there is a large number of |0) control qbits in the output state and an amplitude 
concentration on states different from the input, if there is a large number of |1) control qbits 
in the output state. As a consequence, the most interesting state for information retrieval 
purposes is the projection of iV’fin) onto the subspace with all control qbits in state |0). 

There are two ways of obtaining this projection. The hrst, and easiest one, is to simply 
repeat the above algorithm and measure the control register several times, until exactly the 
desired state for the control register is obtained. If the number of such repetitions exceeds a 
preset threshold T the input is classihed as ”non-recognized” and the algorithm is stopped. 
Otherwise, once |ci,..., Cb) = |0i,..., 0^) is obtained, one proceeds to a measurement of the 
memory register m, which yields the output pattern of the memory. 

The second method is to hrst apply T steps of the amplitude amplihcation algorithm 
[35] rotating iV'fin) towards its projection onto the ’’good” subspace formed by the states 
with all control qbits in state |0). To this end it is best to use the version of the retrieving 
algorithm that does not need an auxiliary register for the input. Let us dehne as R{i) the 
input-dependent operator which rotates the memory state in the Hilbert space enlarged by 


the b control qbits towards the hnal state iV'fin) in eq. (45) (where we now omit the auxiliary 
register for the input): 

= R{i) ... ,0b) . (47) 

By adding also the two utility qbits needed for the storing algorithm one can then obtain 
|'0fin) as a unitary transformation of the initial state with all qbits in state |0): 


00) = R{z)M |0,..., 0; Oi,..., 0^; 00) . (48) 

The amplitude amplihcation rotation of |'0fin;OO) towards its ’’good” subspace in which all 
b control qbits are in state |0) is then obtained [2S] by repeated application of the operator 

Q = -R{i)MSoM-^R-\{)S (49) 

on the state |'0fin; 00). Here S conditionally changes the sign of the amplitude of the ’’good” 
states with the b control qbits in state |0), while S'o changes the sign of the amplitude if 
and only if the state is the zero state |0,..., 0; Oi,..., Of,; 00). As before, if a measurement 
of the control register after the T iterations of the amplitude amplihcation rotation yields 
|0i,..., Ob) one proceeds to a measurement of the memory register, otherwise the input is 
classihed as ” non-recognized”. 



The expected number of repetitions needed to measure the desired control register state 
is with 

( 50 ) 




k=l 


the probability of measuring |ci,..., c„) = |0i,..., 0„). The threshold T governs thus the 
recognition efficiency of the memory. Note, however, that amplitude amplification provides 
a quadratic boost [3S] to the recognition efficiency since only 1 / steps are typically 

required to rotate I'^fin) onto the desired subspace. Accordingly, the threshold T can be 
lowered to a/T with respect to the method of projection by measurement. The crucial point 
is that, due to the quantum nature of the retrieval mechanism, this recognition probabil¬ 
ity depends on the distribution of all stored patterns. A lower bound on the recognition 
probability can thus be established as follows. Of all the stored patterns, all but one have 
Hamming distance from the input smaller or equal than (n — 1). There is only pattern that 
can have a larger Hamming distance equal to n. So we shall use the upper bound (n — 1) 
for the Hamming distance of all patterns but one, for which we shall use the upper bound 
n, and this one does not contribute to the recognition probability since the cosine function 
vanishes. Given that cosine is a decreasing function in the interval [0,7r/2], we get the lower 
bound 


prec y pmin _ P -1 ^^^26 

P 


7r{n — 1) 
2n 


( 51 ) 


For n 3> 1 we can now estimate this lower bound as 


pram ^ 


p 


p 


2nJ 


2b 


( 52 ) 


This shows that, independent of the number p of patterns, the threshold T for recognition can 
be set as a polynomial function of the number n of qubits. Note that this is entirely due to the 


factor (p — 1) in the numerator of (52), which, in turn, depends on the quantum nature of the 
memory. In other words, the probabilistic character of the retrieval process does not limit at 
all the number of possible stored patterns, the typical number of repetitions required would 
be polynomial even for an exponential number or patterns. The efficient implementability 
of the quantum memory is limited only by the number of elementary quantum gates in M, 
which is linear in p. 

In general, the probability of recognition is determined by comparing (even) powers of 
cosines and sines of the distances to the stored patterns. It is thus clear that the worst case 
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for recognition is the situation in which there is an isolated pattern, with the remaining 
patterns forming a tight cluster spanning all the largest distances to the hrst one. As a 
consequence, the threshold needed to recognize all patterns diminishes when the number of 
stored patterns becomes very large, since, in this case, the distribution of patterns becomes 
necessarily more homogeneous. Indeed, for the maximal number of stored patterns p = 2^ 
one has = 1/2^ and the recognition efficiency becomes also maximal, as it should be. 

Once the input pattern i is recognized, the measurement of the memory register yields 
the stored pattern p^ with probability 


n (p‘) 

1 2b 

= -cos 

(|^<i«b/)) . 

(53) 

z 

=ppr = 

I]“s“(l-<i„(i,p*)) . 

(54) 


Clearly, this probability is peaked around those patterns which have the smallest Hamming 
distance to the input. The highest probability of retrieval is thus realized for that pattern 
which is most similar to the input. This is always true, independently of the number of stored 
patterns. In particular, contrary to classical associative memories, there are no spurious 
memories: the probability of obtaining as output a non-stored pattern is always zero. This 
is another manifestation of the fact that there are no restrictions on the loading factor p/n 
due to the information retrieval algorithm. 

In addition to the threshold T, there is a second tunable parameter, namely the number b 
of control qbits. This new parameter b controls the identifieation effieiency of the quantum 
memory since, increasing b, the probability distribution Pf, becomes more and more 
peaked on the low dn {i,P^) states, until 

lim Pb (p^) = 6kk^.^ , (55) 

fe—>oo ' ' 

where fcmin is the index of the pattern (assumed unique for convenience) with the smallest 
Hamming distance to the input. 

While the recognition efficiency depends on comparing powers of cosines and sines of 
the same distances in the distribution, the identihcation efficiency depends on comparing 
the (even) powers of cosines of the different distances in the distribution. Specifically, it is 
best when one of the distances is zero, while all others are as large as possible, such that 
the probability of retrieval is completely peaked on one pattern. As a consequence, the 
identihcation efficiency is best when the recognition efficiency is worst and viceversa. 
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The role of the parameter b becomes familiar upon a closer examination of eq.( 53). 
Indeed, the quantum distribution described by this equation is equivalent to a canonical 
Boltzmann distribution with (dimensionless) temperature t = 1/b and (dimensionless) en¬ 
ergy levels 


=-2 log cos (i,/)) , (56) 

with Z playing the role of the partition function. 

The appearance of an effective thermal distribution suggests studying the average be¬ 
haviour of quantum associative memories via the corresponding thermodynamic potentials. 
Before this can be done, however, one must deal with the different distributions of stored 
patterns characterizing each individual memory. The standard way to do this in similar 
classical problems is to average over the random distribution of patterns. Typically, one 
considers quenched averages in which extensive quantities, like the free energy are averaged 
over the disorder: this is the famed replica trick used to analyze spin glasses [10]. In the 
present case, however, the disorder cannot lead to spin-glass-like phases since there are no 
spurious memories: by construction, probabilistic quantum memories can output only one 
of the stored patterns. The only question is how accurate is the retrieval of the most similar 
pattern to the input as a function of the fictitious temperature t = 1/b. To address this 
question we will ’’quench” only one aspect of the random pattern distribution, namely the 
minimal Hamming distance d between the input and the stored patterns. The rest of the 
random pattern distribution will be considered as annealed. In doing so, one obtains an av¬ 
erage description of the average memory as a function of the fictitious temperature t = 1/b 
and the minimal Hamming distance d. 

To do so we hrst normalize the pattern representation by adding (modulo 2) to all pat¬ 
terns, input included, the input pattern i. This clearly preserves all Hamming distances and 
has the effect of choosing the input as the state with all qbits in state |0). The Hamming 
distance d^ becomes thus simply the number of qbits in pattern with value |1). 

The averaged partition function takes then a particularly simple form: 


JL 

Nx 


{A} j=d 



(57) 


where Xj describes a probability distribution, J2j=d^j ~ 7, with the following properties. 
Let the number of patterns scale as the x*^ power of the number of qubits, p = for 
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n 3> 1. Then 


Xj = 0 , j > n — X , 

Xj < -r , j = n — X , (58) 

^ “ a^x\ ’ ^ ^ 

with all other Xj for j < n — x unconstrained. {A} is the set of such distributions and 

Nx the corresponding normalization factor. Essentially the probability distribution becomes 

unconstrained in the limit of large n. 

We now introduce the free energy F{b, d) by the usual definition 

^av = P = 0) , (59) 


where we have chosen a normalization such that exp(—&F) describes the deviation of the 
partition function from its value for 6 = 0 (high effective temperature). Since Z/p, and con¬ 
sequently also Zs_^Ip posses a finite, non-vanishing large-n limit, this normalization ensures 


that F(6, d) is intensive, exactly like the energy levels (56), and scales as a constant for large 
n. This is the only difference with respect to the familiar situation in statistical mechanics. 

The free energy describes the equilibrium of the system at effective temperature t = 1/h 
and has the usual expression in terms of the internal energy U and the entropy S\ 


F{t,d) =U{t,d)-tS{t,d) , 

U(t,d) ={E),, (60) 


Note that, with the normalization we have chosen in (59), the entropy S is always a negative 
quantity describing the deviation from its maximal value S'max = 0 at f = oo. 

By inverting eq.(56) with F substituting E one can also dehne an effective (relative) 
input/output Hamming distance V at temperature t: 


, , 2 -F(t,d) 

V{t, d) = — arccos e 2 

71 


(61) 


This corresponds exactly to representing the recognition probability of the average memory 


as 


= cosi" (^v(b, d)) , 


(62) 


which can also be taken as the primary definition of the effective Hamming distance. 

The function Vib, d) provides a complete description of the behaviour of the average 
probabilistic quantum associative memory with a minimal distance Hamming distance d. 
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This can be used to tune its performance. Indeed, suppose that one wants the memory 
to recognize and identify inputs with up to en corrupted inputs with an efficiency of v 
(0 < 1 / < 1). Then one must choose a number b of control qbits sufficiently large that 
iT)(b, en) — e) < (1 — n) and a threshold T of repetitions satisfying T > 1/cos^^ [^'D{b, en)), 
as illustrated in Fig. 2 below. 

A first hint about the general behaviour of the effective distance function V{b,d) can be 


obtained by examining closer the energy eigenvalues (56). For small Hamming distance to 
the input these reduce to 

2 




TT^ / du 


dn 


< 1 


n 


n 


(63) 


Choosing again the normalization in which |i) = |0.. .0) and introducing a “spin” sf with 
value sf = —1/2 if qbit i in pattern has value |0) and sf = +1/2 if qbit i in pattern p^ 
has value |1), one can express the energy levels for du/n <^1 as 




TT 

An^ 


TT 

4n 


(64) 




Apart from a constant, this is the Hamiltonian of an infinite-range antiferromagnetic Ising 
model in presence of a magnetic held. The antiferromagnetic term favours conhgurations 
k with half the spins up and half down, so that — 0) giving = 7r^/16.The 

magnetic held, however, tends to align the spins so that = —n/2, giving = 0. Since 
this is lower than vr^/lG, the ground state conhguration is ferromagnetic, with all qbits 
having value |0). At very low temperature (high b), where the energy term dominates the 
free energy, one expects thus an ordered phase of the quantum associative memory with 
V{t,d) = d/n. This corresponds to a perfect identihcation of the presented input. As the 
temperature is raised {b decreased) however, the thermal energy embodied by the entropy 
term in the free energy begins to counteract the magnetic field. At very high temperatures 
(low b) the entropy approaches its maximal value S{t = oo) = 0 (with the normalization 
chosen here). If this value is approached faster than 1/t, the free energy will again be 
dominated by the internal energy . In this case, however, this is not any more determined 
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by the ground state but rather equally distributed on all possible states, giving 


F{t = oo) = U{t = oo) = 


d 


T^i: 


dx 2 log cos 


n 


= 1 + - 2 log2 + O 



(65) 


and leading to an effective distance 


A 2 2 log2 d ^ fd' 

P(t = oo,d) = -- ^- + 0{ - 

3 ^l^/3 n \\n. 


( 66 ) 


This value corresponds to a disordered phase with no correlation between input and output 
of the memory. 


A numerical study of the thermodynamic potentials in (60) and (61) indeed confirms a 


phase transition from the ordered to the disordered phase as the effective temperatnre is 
raised. In Fig. 2 we show the effective distance V and the entropy S for 1 Mb (n = 8 x 10®) 
patterns and d/n = 1% as a fnnction of the inverse temperatnre b (the entropy is rescaled to 
the interval [0,1] for ease of presentation). At high temperatnre there is indeed a disordered 
phase with S = Smax = 0 and V = 2/3. At low temperatures, instead, one is in the ordered 
phase with S = 5' min and V = d/n = 0.01. The effective Hamming distance plays thus the 
role of the order parameter for this quantum phase transition. 

The phase transition occurs around — 10“^. The physical regime of the qnantnm 
associative memory (6 = positive integer) lies thus just above this transition. For a good 
accuracy of pattern recognition one should choose a fictitious temperature low enough to be 
well into the ordered phase. As is clear from Fig. 2, this can be achieved already with a 
nnmber of control qnbits b = 0(10*^). 

Having described at length the information retrieval mechanism for complete, bnt possibly 
corrnpted patterns, it is easy to incorporate also incomplete ones. To this end assnme that 
only q < n qbits of the inpnt are known and let us denote these by the indices {kl ,..., kq}. 
After assigning the remaining qbits randomly, there are two possibilities. One can just treat 
the resulting complete inpnt as a noisy one and proceed as above or, better, one can limit 


the operator {dH)^ the Hamiltonian (42) to 


idH)m = ^ 


i=l 


a- + 1 


(67) 


^ki 
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Order-Disorder Transition of QAMs 



FIG. 2: Effective input/output distance and entropy (rescaled to [0,1]) for 1Mb patterns and 
d/n = 1%. 

so that the Hamming distances to the stored patterns are computed on the basis of the known 
qbits only. After this, the pattern recall process continues exactly as described above. This 
second possibility has the advantage that it does not introduce random noise in the similarity 
measure but it has the disadvantage that the operations of the memory have to be adjusted 
to the inputs. 

Finally, it is fair to mention that the model of probabilistic quantum associative memory 
presented here has been criticised [36] on three accounts: 

• It has been claimed that the same result could have been obtained by storing only one 
of the p patterns in n classical bits and always using this single pattern as the same 
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output independently of the input, provided the input has a Hamming distance to the 
unique stored pattern lower than a given threshold, otherwise the input would not be 
recognized. 

• It has been claimed that the Holevo theorem bounds the number of patterns that can 
be stored in a quantum associative memory. 


It has been pointed out that the complexity of memory preparation prevents the 
efficient storing of patterns. 


This criticism is wrong on the hrst two accounts and partially justihed on the third [37]. It is 
true that both the quantum memory and the proposed equivalent classical prescription are 
based on probabilistic recognition and identihcation processes. In the proposed classical 
alternative, however the probabilities for both recognition and identihcation depend on 
one unique, fixed and random pattern whereas in the quantum memory, exactly due to 
its quantum character, these probabilities depend on the distribution of all stored patterns. 
These probabilities are such that an input different from most stored patterns is more difficult 
to recognize than an input similar to many stored memories and that the identihcation 
probability distribution can be peaked with any prescribed accuracy on the stored pattern 
most similar to the input. In the proposed classical alternative, given that only one single 
pattern can be stored on the n classical bits, the recognition or lack thereof depend on the 
distance to a randomly chosen pattern and the identihcation probability is a delta function 
peaked on this hxed random pattern. In other words there is no correlation whatsoever 
between input and output apart from the fact that they have Hamming distance below 
a certain threshold, a prescription that can hardly qualify as an associative memory: it 
would indeed be a boring world the one in which every stimulus would produce exactly the 
same response, if any response at all. Also, the Holevo theorem [26] does not impose any 
limitation on this type of probabilistic quantum memories. The Holevo theorem applies 
to the situation in which Alice codes information about a classical random variable in a 
quantum state and Bob tries to retrieve the value of this random variable by measurements 
on the received quantum state. In the present case Alice gives to Bob also corrupted or 
incomplete classical information about the random variable (the input) and Bob can use 
also a unitary transformation that encodes both the memories and the input (operator R{i) 


in (47)) in addition to measurements, a completely different situation. Contrary to what the 


36 



authors of [36] affirm, a memory that ’’knows the patterns it is supposed to retrieve” not only 
makes sense but it is actually the very dehnition of an associative memory: if the memory 
would not ’’know” the data it has to retrieve it would just be a random access database, 
exactly the architecture that one wants to improve by content association, the mechanism 
whose goal is to recognize and correct corrupted or incomplete inputs. The dynamics of the 
classical Hopheld model ’’knows” the patterns it is supposed to retrieve: they are encoded 
in the neuronal weights. So does any human brain. Finally, the third critique is partially 
correct. The complexity of the memory operator M is 0{pn) and thus the original claim 
[13] of an exponential capacity gain by quantum associative memories is excessive. This, 
however, does not invalidate the main claim, a large gain in capacity is made possible by 
quantum mechanics, albeit only a polynomial one. This correction has been incorporated in 
the present review. 


C. Efficiency, complexity and memory tuning 


In this last section we would like to address the efficient implementation of probabilistic 
quantum memories in the quantum circuit model [1] and their accuracy tuning. 

We have stressed several times that all unitary operators involved in the memory prepa¬ 
ration can be realized as a sequence of one- and two-qubit operators. It remains to prove 
that this is true also for pattern retrieval and that all these operators can be implemented 
in terms of a small set of universal gates. To this end we would like to point out that, 
in addition to the standard NOT, H (Hadamard), XOR, 2XOR (Toffoli) and nXOR gates 


[1] we have introduced only the two-qbit gates OS'* in eq. (22) and the unitary operator 
exp [m'H/2n). The latter can, however also be realized by simple gates involving only one 
or two qbits. To this end we introduce the single-qbit gate 


U = 


e*^ 0 
0 1 


( 68 ) 


and the two-qbit controlled gate 


CU-^ = |O)(O|®l + |l)(l|0f/ 


-2 


(69) 
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It is then easy to check that exp (i 7 r'H/ 2 n) in eq. (41) can be realized as follows: 


IV. 2 ) = n nt'™, IV’^) . (70) 

i=l j=l 

where c is the control qbit for which one is currently repeating the algorithm. Essentially, 
this means that one implements hrst exp {iirdn/‘2,n) and then one corrects by implementing 
exp {—indH/n) on that part of the quantum state for which the control qbit |c) is in state 
| 1 )- 

Using this representation for the Hamming distance operator one can count the total 
number of simple gates that one must apply in order to implement one step of the information 
retrieval algorithm. This is given by ( 6 n + 2) using the auxiliary register for the input and by 
(4n + 2) otherwise. This retrieval step has then to be repeated for each of the b control qbits. 
Therefore, implementing the projection by repeated measurements, the overall complexity 
C of information retrieval is bounded by 

C < Tb{6n + 2)C'm , (71) 

where Cm is the complexity of the memory preparation, given by the operator M or a 
probabilistic cloning machine. In particular, it is given by 

C = T 6 ( 6 n + 2) (p(2n + 3) + 1) , (72) 


for the simplest version of the algorithm, using memory preparation by M and an auxiliary 
input register. 

The computation of the overall complexity is easier for the information retrieval algorithm 
which uses the amplitude amplihcation technique. In this case the initial memory is prepared 
only once by a product of the operators M, with complexity p{2n + 3) + 1 and R{i), with 
complexity 6(4n + 2). Then one applies T times the operator Q, with complexity + 
6 ) + 6 ( 8 n + 4) + 2 + C 5 + Csq, where C 5 and Csq are the polynomial complexities of the 
oracles implementing S and Sq. This gives 


C = T [p(4n + 6 ) + b{Sn + 4) + 2 + Cs + CsJ + 
+p{2n + 3) + b{4n + 2) + 1 . 


(73) 


As expected, the memory complexity (be it (72) or (73)) depends on both T and 6 , the 
parameters governing the recognition and identihcation efficiencies. The major limitation 
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comes from the factor p representing the total number of stored patterns. Note however 
that, contrary to classical associative memories, one can efficiently store and retrieve any 
polynomial number of patterns due to the absence of spurious memories and crosstalk. 

Let us hnally show how one can tune the accuracy of the quantum memory. Suppose 
one would like to recognize on average inputs with up to 1% of corrupted or missing bits 
and identify them with high accuracy. The effective i/o Hamming distance T> shown in 
Fig. 2 can then be used to determine the values of the required parameters T and b needed 
to reach this accuracy for the average memory. For b = 10^ e.g., one has V = 0.018, 
which gives the average i/o distance (in percent of total qbits) if the minimum possible 
i/o distance is 0.01. For this value of b the recognition probability is 3.4 10“^. With 
the measurement repetition technique one should thus set the threshold T ~ 3000. Using 
amplitude amplihcation, however, one needs only around T = 54 repetitions. Note that the 
values of b and T obtained by tuning the memory with the effective i/o Hamming distance 
become n-independent for large values of n. This is because they are intensive variables 
unaffected by this ’’thermodynamic limit”. For any hxed p polynomial in n, the information 
retrieval can then be implemented efficiently and the overall complexity is determined by 
the accuracy requirements via the n-independent parameters T and b. 


V. CONCLUSION 

We would like to conclude this review by highlighting the fundamental reason why a 
probabilistic quantum associative memory works better than its classical counterpart and 
pointing out about some very intuitive features of the information retrieval process. 

In classical associative memories, the information about the patterns to recall is typically 
stored in an energy function. When retrieving information, the input conhguration evolves 
to the corresponding output, driven by the dynamics associated with the memory function. 
The capacity shortage is due to a phase transition in the statistical ensemble governed by 
the memory energy function. Spurious memories, i.e. spurious metastable minima not 
associated with any of the original patterns become important for loading factors p/n above 
a critical value and wash out completely the memory, a phenomenon that goes by the name 
of crosstalk. So, in the low p/n phase the memory works perfectly in the sense that it 
outputs always the stored pattern which is most similar to the input. For p/n above the 
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critical value, instead, there is an abrupt transition to total amnesia caused by spurious 
memories. 

Probabilistic quantum associative memories work better than classical ones since they 
are free from spurious memories. The easiest way to see this is in the formulation 

|m) = M |0) . (74) 


All the information about the stored patterns is encoded in the unitary operator M. This 
generates a quantum state in which all components that do not correspond to stored patterns 
have exactly vanishing amplitudes. 

An analogy with the classical Hopheld model [S] can be established as follows. Instead of 
generating the memory state |m) from the initial zero state |0), one can start from a uniform 
superposition of the computational basis. This is achieved by the operator MW dehned by 

2 ^ — 1 

\m) 

V ^ j=Q 
n 

W = n ■ (75) 

Now, this same result can also be obtained by Grover’s algorithm, or better by its general¬ 
ization with zero failure rate [38]. Here the state \m) is obtained by applying to the uniform 
superposition of the computational basis q times the search operator X dehned in 


m) 

X 


2"-l 


V ^ j=o 

= -WJqWJ , 


(76) 


where J rotates the amplitudes of the states corresponding to the patterns to be stored 
by a phase 0 which is very close to vr (the original Grover value) for large n and Jo does 


the same on the zero state. Via the two equations (75) and (76), the memory operator M 
provides an implicit realization of the phase shift operator J. Being a unitary operator, 
this can always be written as an exponential of an hermitian Hamiltonian T-Lm, which is the 
quantum generalization of a classical energy function. By dehning J = exp {—H-Lm) one 
obtains an energy operator which is diagonal in the computational basis and such that the 
patterns to be stored have energy eigenvalues E = —0 ~ —vr while all others have energy 
eigenvalues 77 = 0. This formulation is the exact quantum generalization of the Hopheld 
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model; the important point is that the operator M realizes efficiently a dynamics in which 
the patterns to be stored are always, for any number p of patterns, the exact global minima 
of a quantum energy landscape, without the appearance of any spurious memories. 

The price to pay is the probabilistic nature of the information retrieval mechanism. As 
always in quantum mechanics, the dynamics determines only the evolution of probability 
distributions and the probabilistic aspect is brought in by the collapse of this probability 
distributions upon measurement. Therefore, contrary to the classical Hopheld model in the 
low p/n phase, one does not always have the absolute guarantee that an input is recognized 
and identihed correctly as the stored pattern most similar to the input, even if this state 
has the highest probability of being measured. But, after all, this is a familiar feature of 
the most concrete example of associative memory, our own brain, and should thus not be 
so disturbing. Indeed, it is not only the probabilistic nature of information retrieval that 
is reminiscent of the behaviour of the human brain but also the properties of the involved 
probability distributions. These are such that inputs very similar to a cluster of stored 
patterns will be much easier to recognize than inputs farther away from all stored memories, 
although the former situation will lead to a more difficult identihcation of the most similar 
memory. Quantum entanglement allows to construct such a probabilistic content association 
with a very high storage capacity. 
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